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A deterministic  signal  s in  zero  mean  Gaussian  noise TJ  Is  observed  • 

through  a zero  memory  nonlinearity  f(x).  The  reconstruction  of  the  sig- 
nal is  considered  when  the  nonlinearity,  the  noise  covariance  and  the 
first  or  second  order  moments  of  the  output  process  f[s+N]  are  known. 

Arbitrary  signals  can  be  reconstructed  for  monotonic  and  certain  odd,  not 
necessarily  monotonic,  nonlinearities;  Included  here  are  hard  limiters, 
quantizers  and  infinite  interval  windows.  Arbitrary  signals  can  be  re- 
constructed, up  to  a global  sign,  for  two  distinct  classes  of  even  non- 
linearities;  included  here  are  2v-th  law  devices  and  synmetric  Interval 
windows.^- — ^ Q 
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1.  INTRODUCTION 


Consider  a signal  s observed  through  a nonlinear  system  and  suppose 
that  we  want  to  reconstruct  the  signal  from  the  output  of  the  system.  Un- 
less the  nonlinear  system  is  one-to-one,  an  unrealistic  situation,  the 
signal  cannot  be  uniquely  reconstructed.  As  a simple  example,  consider  the 
zero  memory  nonlinearity  f ( x ) = l^a  ^(x):  The  only  information  about  s(t) 
contained  in  the  output  f[s(t)]  is  whether  s(t)  * a or  s(t)  > a and  It  Is 
evident  that  there  Is  an  uncountably  infinite  number  of  signals  having  the  same 
output.  Intuitively,  this  situation  may  improve  if  there  Is  an  additive 
noise  N at  the  input  of  the  nonlinear  system  so  that  the  observed  output 
is  f[s(.t)  + N(t)].  If  the  set  of  values  of  the  random  variable  N(t)  Is  suf- 
ficiently large,  knowledge  of  certain  moments  of  the  output  f[s(t)  + N(t)] 
may  provide  more  informa ‘-ion  on  the  signal  than  in  the  absence  of  noise. 

This  is  indeed  true  when  the  marginal  distributions  of  the  noise  are  Gaussian, 
in  which  case  the  signal  can  he  uniquely  reconstructed  as  shown  in  Theorem  1. 
The  idea  that  additive  input  noise  helps  in  reconstructing  the  signal  was 
first  raised  by  Grunbaum  [ 1 J and  is  investigated  in  this  paper. 

Specifically,  we  consider  a deterministic  signal  s In  additive  stationary 
Gaussian  noise  N,  with  zero  mean  and  covariance  function  R,  observed  through 
a zero  memory  nonlinearity  f.  We  are  concerned  with  the  reconstruction  of 
the  signal  from  the  knowledge  of  the  nonlinearity  f,  the  noise  covariance  R, 


and  the  first  or  second  order  moments  of  the  output  process  f(s+N) 

. We  show 

V 
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that  the  signal  can  be  reconstructed  in  the  following  cases. 
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( 1 ) From  the  knowledge  of  the  nonlinearity  f,  the  variance  R(0)  of 
the  noise,  and  the  first  or  second  moment  of  the  output,  the  signal  Is  re- 
constructed for  monotonic  nonlinearities  which  need  not  be  strictly  mono- 
tonic (Theorem  1)  as  well  as  for  some  odd  nonlinearities  with  non-negative 
Hermlte  coefficients  (Theorem  2).  Included  here  are  hard  and  soft  limiters 
and  Infinite  interval  windows. 

(11)  From  the  knowledge  of  the  nonlinearity  f,  the  noise  covariance 
function  R whose  zeros  are  assumed  Isolated,  and  the  mean  and  correlation 
functions  of  the  output,  the  signal  Is  reconstructed  up  to  a global  sign 
for  the  following  two  classes  of  even  nonllnearitles:  (a)  bounded  below 
or  above  and  monotonic  on  the  positive  real  line,  (b)  with  nonnegative 
Hermlte'  coefficients.  Included  here  are  2v—  law  devices  and  symmetric 
interval  windows.  Similar  results  are,  in  fact,  established  for  nonllnearitles 
symmetric  around  an  arbitrary  point.  (Theorem  4). 

Here  we  are  assuming  that  the  noise  covariance  function  R Is  known.  The 
problem  of  reconstructing  the  noise  covariance  R from  the  correlation  func- 
tion of  the  output  process  f(N),  i.e.  the  signal-free  case,  has  been  con- 
sidered in  [2], [3]. 

The  stationarlty  assumption  on  the  Gaussian  noise  Is  used  only  to  make 
the  signal  reconstruct! " feasible  from  a practical  viewpoint.  Even  though 
It  Is  not  stated  so,  Th  •;ms  1 to  3 need  only  the  one-dimensional  distribu- 

tions of  the  noise  to  b»  si  an,  while  Theorem  4 requires  the  bivariate 
distributions  of  the  no,  - ^o  be  Gaussian.  It  should  be  clear  that  results 
similar  to  Theorems  1 4 woi.ld  also  be  true  for  other  noise  processes  with 

sufficiently  smooth,  s;'  *,ric  first  and  second  order  distributions. 
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The  organization  of  the  paper  Is  as  follows:  The  results  on  the  recon- 
struction of  the  signal  are  presented  and  discussed  In  Section  III.  The 
derivations  In  Section  III  are  kept  to  a minimum  by  collecting  the  essential 
elements  of  the  proofs  Into  propositions  which  are  presented  In  Section  II 
and  could  be  of  Independent  interest. 


II.  CERTAIN  MOMENT  PROPERTIES  OF  FUNCTIONS 
OF  GAUSSIAN  RANDOM  VARIABLES 

In  this  section  we  study,  for  use  In  the  following  section,  certain 
properties  of  the  moment  functions 

yf(x)  - E[f(£<x)]  (1) 

and 

rf(x,y;p)  - E[f(£+x)f(n+y)]  (2) 

where  £ and  n are  jointly  Gaussian  random  variables  with  means  zero,  variances 
a , correlation  coefficient  p,  joint  density  $(x,y;p)  and  marginal  densities 
$(x;o);  f Is  a (nonconstant)  real-valued  Borel  measurable  function  on  the 
real  line.  As  the  notation  Indicates,  we  treat  f and  a as  fixed  and  we  con- 
sider the  dependence  of  \.  on  xf  (-«,<»)  and  of  r on  x,y€  (-*,*»)  and  p£  [-1,1]. 

The  following  moment  Inequality  simplifies  the  conditions  under  which 
y and  r exist 

E|f(E+x)|  sexp[xW]  t!/2[f2(£)].  (3) 

Thus 

E[f2(E)]  < 00  ■*  E|f(£*x)  -»  for  all  x. 

This  can  be  'Obtained  as  follows: 

E|f(E+x)|  = r |f(u+x)|<j>(u;o)du  ■ f°  | f(y) (♦(y-x;a)dy 

-OD  -00 

- exp[x2/2o2}  r K(y)U1/2(y;o)^1/2(y-2x;o)dy 

-a> 

1 / 2 

* exp[x2/2o2]  | r f2(y)$(y;o)dy  • f ♦(y-2x*,o)dyj 

~au  ••  ’ 

- txpCxW]  F,/2[f2(5)]. 
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It  then  follows  from  (3)  that  y^(x)  exists  for  all  x provided  E[f^(E)]<®, 
and  Tf(x,y;p)  exists  for  all  x,y  and  p€  [-1,1]  provided  E[f*(E)]<«. 

We  first  ierive  certain  analytical  properties  of  y^. 

p 

Proposition  1.  If  E[f  (E)]  < ®»  then  for  all  -®<x<*>,  y^(x)  has  the  power 
series  representation 


yf(x)  ■ l akxK, 
T k*=0  K 


where 

ak  * “W  r f(x)  Hk  n(x)<j>(x;o)dx 

k k!a  K -«  K’° 

and  the  convergence  Is  absolute.  y^(x)  is  Infinitely  differentiable  and 
Uf^(x)-has  the  Integral  representation 

4n)(x) = -?n  ^°°  f(y+x>Hn  0(yMr.o)dy  • (&) 

0 -00  * 

Proof,  The  Hermite  polynomials  {Hk  0(E)}£=oare  the  orthogonal Izatl on  (not 

* h oo 

orthonormalization)  of  the  sequence  (E  }k=Q  v^a  Gram-Schmldt  procedure. 
{Hk  o(x)}^_0  Is  a complete  orthogonal  set  in  LgUUvjJdx)  and 

j0B  Hk,o,x!  = «*p(«-  ?«2*2) 

* k! 

E[Hk0(etx)]  - xk  (6) 

where  (6)  Is  shown  In  [1].  Since  f(x) € l.2($(x;o)dx) , we  have 

f(E)  * l H.  (e) 

k^O  K 

In  quadratic  mean,  where 


5 


! 


) 

J 


! 


■ \eK>0<e)] 

or 

r ^(y)Hkia(y)«l»{y;o)dy  - ak  k!  o2k  . 
Now  Inequality  (3)  Implies  that 

OP 

f(y+x)  ■ l a.  H.  (y+x) 
k*0  * . '° 

In  L-|U(y;o)dy)  for  all  x and  hence 

ao 

y(x)  « E[f(£+x)]  » l a.  E[Hk  (5+x)] 

. n x x,o 


where  the  last  step  follows  by  (6).  The  absolute  convergence  of  the  series 
(4)  Is  seen  as  follows.  We  have 

“ > E[f2(03  ■ l a2  e[h2  (03  - J a2o2kk!  , 
k*0  K,a  k*0  * 

so  that  ajjo  k!+0  as  k-*«  and  for  large  k,  |ak|  * to  /Ail  . Thus  it  suffices 
to  show  that  for  each  x 

l Uri/rf  < . 

k»0  MT 


which  follows  easily  from  the  ratio  test.  The  power  series  representation  (4) 
Implies  that  p(x)  Is  Infinitely  differentiable,  has  a finite  number  of  extrema 
on  each  finite  interval,  and  is  not  constant  on  any  Interval. 


The  derivation  of  (5)  proceeds  as  follows.  From  (4)  we  have 
,(n)/0\  _ " . k!  „k-n 


y (x)  * k\n  #k  H^nTT  x 


,k-n 


k 7*^7  L f(y)Hk.o(y)*(y,o)<ly  • 


d 


Hence  If  for  each  fixed  x 


l / I f (y) I |Hk  (y) | -Ui-- 4>(y;o)dy  < » 

k-n  -®  K,°  o^K(k-n)l 

then  by  the  bounded  convergence  theorem t 

M(n)(x)  “ / f(y)  l -gr Hk  (y)  4>(y;o)dy 

k»n  o K(k-n)i  ’ 

Now  the  term  in  brackets  Is  equal  to 


I *-x£^  Hk  (y)  . e*p[^] 

3x  k*0  k*  k,a  3x  2 a 


= exp[y2/2o2]  exp[-  -L  (y-x)2] 
3xn  2c/ 


Thus 

P^(x)  3 / f(y)  H a(y-x)4>(y-x;o)dy  . 

a * 

We  now  verify  (7).  The  expression  in  (7)  is  equal  to 


? i$£-~ 

k-n  o(k-n) ! 


,(e)|] 


1 l ■1^--E1/2[f2(F,)]  E,/2[H2  m 
k-n  (j  (k-n)l 


l i eVV(03  ? 


E1/2tf2(C)]  l - i 

k=n  oK ( k-n ) ! on 


x /o  vvn+ir 


and  the  sum  in  the  last  expression  above  is  finite  by  the  root  test.  □ 

We  now  derive  a series  expansion  of  the  second  order  moment  function 
rf(x,y;p)  in  terms  of  the  derivatives  of  the  first  order  moment  function  y^(x) 
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Proposition  2.  If  E[f4(03  < * • then  for  all  -«<x,y<«  and  -1<p<1,  we  have 

rf(x,y;p)  - f 4n)(x)u<">(y)  . 

n»0 

Proof.  Since  E[f4(03  < 00  . Inequality  (3)  Implies  that  E[f2U+x)]  < °°  for 
all  -«<x<”  and  thus 

r(x,y;p)  - E[fU+x)f(n+y)3 

Is  well  defined  and  finite  for  all  -«<x,y<«  and  -lspsl.  Now  for  all 
-oo<Utv«»  and  -l<p<l  we  have  [4] 

00  n 

1 

n*0  n!o 

00  2n 

and,  since  \ |p|  < <«,  the  convergence  Is  also  In  U(4>(u;a)<|>(v;a)du  dv), 

n=0  L ‘ 

Finally,  since  f(u+x)f(v+y)  is  in  L2(<|>(u ;a)<|>( v ;a)du  dv).  It  follows  that 
r(x,y;p)  * //  f(u+x)f(v+y)  4>(u;o)<J>(v;a)du  dv 

00  p 00 

* l //  f(u+x)f(v+y)  Hn  o(u)  Hn  a(vH(u;o)$(v;a)du  dv 

n*0  n ! a -°°  * * 

and  the  result  follows  from  (5)  of  Proposition  1.  O 


♦(tMo)  • 1 ±Tn  HB.0(»>HB|g(»). 


We  finally  establish  a certain  lack  of  symmetry  of  the  function  r^,  which 
plays  a crucial  role  In  the  reconstruction  of  the  signal  when  the  function  f 
Is  sywnetrlc. 


Proposition  3.  If  the  nonconstant  function  f Is  symmetric  around  some  Xg  and 
satisfies  (a)  or  (b): 

(a)  f Is  bounded  below  or  above,  monotonic  on  [xg,»)  and  such  that 
E[f4(E)]  < 

(b)  E[f4(c+X|j)]  < » and  the  coefficients  UjnC-l  ffx+Xg)  in  its 
Hermlte  expansion  are  nonnegative, 


then 

rf(Vx,xn+y;p)  / rf(xn-x,xn+y;p) 

f 0 0 f 0 0 for  all  x>y>p  ^ (8) 

rf(x0+x,x0+y;p)  t rf(x0+x,x0-y;p) 

It  should  be  noted  that  when  p-0,  equality  holds  In  (8)  for  all  x,y. 

Indeed,  we  have 

rf(x,y;0)  * uf(x)pf(y) 

and  for  all  x, 

pf(xQ+x)  ■ v»f (xQ-x)  = f°  [f(u+xQ+x)  - f ( u+Xq-x) ]4>(u;a)du  « 0 

>00 

since  f(u+xQ+x)  - f(u+xQ-x)  is  an  odd  function  of  u. 

Proof.  Putting  g(x)  = f{x+xQ),  It  Is  clear  that  g has  all  the  properties 
that  f has  with  Xq30  and  that 
rg(x,y;p)  = E[g(C+x)g(n+y)] 

* E[f(^x0+x)f(n+x0+y)] 

* rf(xQ+X,x0+y;p). 

Thus  It  suffices  to  prove  (8)  In  the  case  x0s0. 

(a)  Assume  f satisfies  condition  (a).  Without  loss  of  generality,  we 
may  replace  the  property  that  f Is  bounded  below  (or  above)  by  the  property 
that  f(x)  i 0 (or  s 0)  for  all  x.  Indeed,  If  f Is  bounded  below,  say,  l.e. 

If  f(x)  i A > -»  for  all  x,  putting  q(x)  - f(x)  -A,  we  have  q(x)  25  0 and 

rq(x,y;p)  - rq(-x,y;p)  = Tf(x,y;p)  - rf(-x,y;p) 

rq(x,y;p)  - rq(x,-y;p)  = rf(x,y;p)  - rf(x,-y;p)  . 

These  equations  follow  from 

rq(x,y;p)  - rq(x,-y;p)  = rf(x,y;p)  - rf(x,-y;p)+AE[f(n+y)-f(n-y)3 

i 

i 
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and  the  fact  that  [f(v+y)  - f(v-y)]  Is  an  odd  function  of  v which  implies 
that  E[f(n+y)-f(n-y)]  B0. 

Thus,  under  Assumption  (a),  It  suffices  to  prove  the  result  when  the 
nonconstant  function  f Is  nonnegative,  even  and  nondecreasing  on  [0,®). 

When  p * ±1 , then  £ = mas.  and 

r(x,y;±l)  - r(x ,-y ) = /"f(±u+x)[f(u+y)-f(u-y)]<fr(u;o)du  . 

.00 

It  Is  seen  that  the  term  in  bracket  Is  an  odd  function  of  u which  is  nonnegative 
on  [0,®).  Since  f Is  even,  nonnegative  and  nondecreasing  on  [0,®),  it  follows 
that  for  all  x,y  f 0,  the  integral  is  nonzero. 

From  now  on  we  assume  that  0<p<l  (the  rase  -l<p<0  can  be  treated  simi- 
larly). Then 

<o 

r(x,y;p)  - r(x,-y;p)  = JJ  f (u+x)[f (v+y)-f(v-y)]$(u,v;p)du  dv. 

.<JU 

Denoting  by  4>(v|u)  * $(u,v;p)/4>(u;o)  the  conditional  density  of  n given  C»u, 

2 2 

which  is  Gaussian  with  mean  pu  and  variance  a (1-p  ),  we  have 

r(x,y;p)  - r(x,-y;p)  = /“f(u+x)<t>(u;o)  (/“ f ( z)C4>(z-y |u)-<|>(z+y |u)]dz)du 

.'JO  WOU 

(ft 

* / f(u+x)<fr(u;o)J(u;y)du  , (9) 

_co 

where 

00 

J(u,y)  * / f(z)[4»(z-y|u)  - $(z+y|u)]dz  . 

•CO 

Note  that  as  a function  of  z,  (J(z-y|u)  - 4>(z+y|u)]  Is  antisymmetric  around 
z * pu  and  Is  positive  on  (pu,").  Now  since  f(z)  Is  even  and  nondecreasing 
on  [0,«),  we  can  write  (see  Fig.  1) 
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. -pu  pu  3pu  00 

J(u.y)  - / + / + / ♦ / 

-oo  — pu  pu  3pp 

and  conclude  that  for  u>0  we  have 

-pu  - pu  3pu 

J + / > 0 and  / + / * 0 

3pu  -pu  pu 


so  that  J(u,y)  * 0 for  u>0,  and  similarly  J(u,y)  * 0 for  u<0.  It  is  also 
clear  that  J(0,y)  ■ 0,  that  J{u,y)  is  an  odd  function  of  u,  and  that  J(u,y) 
is  not  identically  zero  as  a function  of  u.  Finally,  since  f Is  even,  non- 
constant, nonnegative,  and  nondecreasing  on  [0,°°),  it  follows  from  (9)  that 
for  all  x.y  f 0,  we  have 

r(x,y;p)  - r(x,-y;p)  f 0 . 

It  is  shown  similarly  that  r(x,y;p)  - r(-x,y;p)  f 0 for  all  x.y  f 0.  Thus 
the  proof  of  the  proposition  under  Assumption  (a)  is  complete. 


(b)  Assume  now  that  f satisfies  Assumption  (b)  (with  xQ*0).  Since  f Is 

even,  we  have  a =0  for  all  odd  n so  that 
n 


f«>  * J0  *2n  <"» 

In  quadratic  mean. 

We  first  consider  the  case  p«l  (the  case  p*-l  being  similar).  Then 
a.s.  and 

00 

r(x,y;l)  * E[f(S+x)f(S+y)3s  / f(u+x)f(u+y)$(u;o)du 

•00 

00 

* / f(z)f(z-x+y)$(z-x;o)dz 


■ E(f(0Cf(C-x+y)^(?-x;o)^"1(5,.p)]) 
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Now  the  random  variable  in  bracket  has  a finite  second  moment  for  all  x,y, 


since 

/ f2(z-x+y)  dz  ■ exp[x2/o2]  / f2(z-x+y)<f>(z-2x;o)dz 

- exp[x2/o2]  E[f2(£+x+y)] 

< exp  E’/VfC)]  < - 

1 2o  ’ 

2 

where  the  Inequality  follows  from  (3)  applied  to  f . Since  f has  the  ex- 
pansion (10)  in  quadratic  mean,  we  then  have  by  (11) 

00  oo 

r(x,y;l)  * l a2n  / H2n  a(z)f(z-x+y)<J»(z-x;o)dz  . (12) 

n»0  * 

Similarly,  we  obtain  for  the  integral  In  (12) 

OO  00 

/ H2n  o(z)f(z-x+y)<j>(z-x;o)dz  - / f(u)H2n  a(u+x-y)*(u-y;a)du 

wOO  * —GO  * 

■ E{f (t) Cn2n  a(r,+x-y)d>(4-y;cx)d>"1  (c;a) ] } 

‘ Jo  a2'"ECHa".o(£tJ')H2".o(f;tx)]  • 

It  then  follows  by  (12)  that 

n*'r'})  ‘ n,L  a2''*2"'EtH2'>.oU+x)Ha".o(£+J')j'  (13) 

Since 


we  can  evaluate  the  expectation  in  (13),  using  the  orthogonality  of  the 
Hermlte  polynomials,  and  obtain 


_/  1 v V . . 2m1n(n,m)  .jjnu  2k  2n-k  2m-k 

r{x,y;l)  - l a?  a-  I k!(  k )(  k )o  x y , 
n,m«0  zn  m k-0  K K 

and  thus 

r(x,y;l)  - 1J  - 2 l .2n%  2",f'm)M(2")(>2kx2"-V”-k  . 

n,m«l  zn  **  k-0  K K 

Since  a2n  *0,  n *1,  with  at  least  one  coefficient  being  strictly  positive 
(since  f Is  nonconstant).  It  Is  clear  that 

r(x,y;l)  - r(x,-y;l)  f 0 for  all  x.y  t 0. 

Now  let  -1  < p<  1.  Since  f Is  even,  we  have  by  (4)  of  Proposition  1 

that 


■ „L  ^ ‘ 


2k-n 


’2k 


2ksn 

which  Is  an  even  function  of  x for  n even  and  odd  for  n odd.  Then  from 
Proposition  2,  we  obtain 

r(x,y;p)  - r(x.-y;p)  - J i pno2nutn)(x)[y(n)(y)-M(n>(-y)] 

n»0 


04) 


• 2 j T?HVp2n-,o2<2n-1)W<2"-i)(x)«(2"-1)(y).  05) 


Again,  since  a2((*0,  K * 1 • at  least  one  co«^^c<ent  being  strictly 
positive,  we  have  by  (14)  that  y^n”^(x)  i 0 for  x ^ 0 for  all  n such  that 
p(2n-l)(x)  not  identically  zero.  It  Is  then  clear  from  Cl 5)  that 
r(x,y;p)  - r(x,-y;p)  + 0 for  all  x.y.p^O  . 

The  proof  of  r(x,y;p)  - r(-x,y;p)  t 0 for  all  x,y,pjft)  Is  similar  and 
thus  the  proof  of  the  proposition  under  Assumption  (b)  Is  complete.  D 


at 
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III.  THE  RECONSTRUCTION  OF  THE  SIGNAL 


In  this  section,  we  consider  the  problem  of  reconstructing  the  real 
deterministic  signal  s * (s(t) ,-»<t«»}  from  the  knowledge  of  the  nonlinearity 
f and  the  first  or  second  order  moments  of  the  output  process 
f(s+N)  = {f[s(t)+N(t;],-~<t<<®},  where  the  noise  N » {N(t) ,-»<t<»}  Is  a real 
stationary  Gaussian  process  with  mean  zero  and  known  continuous  covariance 
function  R(t)  with  R(0)  - a2.  Since  f Is  known,  so  are  the  functions  p^(x) 
and  r^(x,y;p)  Introducted  in  Section  II.  Also  known  are  one  or  more  of  the 
following  functions:  The  moments  m^t)  of  the  output  process 

i\(t)  - E{fk[s(t)+N(t)]}  = Mfk[s(t)],  k * 1,2, 

and  the  correlation  function  C( t ,t)  of  the  output  process 
C(t,x)  = E{f[s(t)fN(t)]f[s(T)+N(x)]} 

- rf[s(t),s(x);  BLSjiL]  . 

a 

We  present  several  results  on  the  reconstruction  of  the  signal  s for  various 
classes  of  nonlinearities  f.  It  is  Important  to  note  that  the  propositions  of 
Section  II  constitute  the  crux  of  the  proofs  of  these  results.  By  referring 
to  these  propositions,  the  derivations  In  this  section  become  clear  and  simple. 

We  first  consider  monotonic  nonlinearities  for  which  reconstruction  of  the 
signal  s is  always  possible,  which  Is  quite  clear  on  Intuitive  grounds  as  well. 

Theorem  1.  The  signal  $(t)  can  be  reconstructed  from  the  k-th  moment  mk(t), 

k * 1 or  2,  of  the  output  process  when  the  nonlinearity  f Is  such  that  f (x)  Is 

L 

monotonic  and  nonconstant  and  f (x) € LzU(x;o)dx). 


Proof.  By  (5)  of  Proposition  1,  we  have  for  all  x 


Pfk(x)  " \ I fk(y+x)  H]  0(y)  4>(y ;o)dy 

a ~co  * 

00 

* “V  / y[fk(x+y)  - fk(x-y)]4>(y;a)dy . 
ad  0 

Ic  Ic  k 

If  f (y)  Is  nonconstant  and  nondecreasing,  say,  then  f (x+y)  - f (x-y)  *0 

and  leb{y  : fk(x+y)  - fk(x-y)  >0}  > 0 for  all  x.  It  follows  that  y|k(x)  > 0, 

ft/ 

-“<x«»,  l.e.  wfk(x)  Is  strictly  Increasing.  Similarly,  f (x)  nonconstant 
and  nonincreasing  Implies  that  Mfk(x)  Is  strictly  decreasing.  Hence  s(t)  can 
be  reconstructed  from  m^t)  * ufkts(t)].  □ 

Aside  from  the  Integrablli ty  conditions,  the  nonl Inearl  ties  covered  by 

m 

Theorem  1 are  those  which  are  monotonic  or  whose  absolute  values  are  monotonic 
(values  of  k larger  than  2 do  not  enlarge  this  class).  Examples  of  monotonic 
nonl Inearl  ties  satisfying  the  conditions  of  Theorem  1 are  the  hard-limiter, 
smooth- 11 miters,  quantizers,  v-law  devices  with  v odd  and  Infinite  Interval 
windows  1(^>a)(*)  or  l(a>uj)<x). 

It  should  be  emphasized  that  the  nonlinearity  f Is  assumed  to  be  monotonic 
but  not  strictly  monotonic  and  thus  the  result  of  Theorem  1 Is  a substantial 
Improvement  over  the  no  noise  case.  As  a simple  example  that  Illustrates  this 
point  well,  consider  the  monotonic  nonlinearity  f(x)  * 1^4  wj(x) ,-»<a<®.  In 
the  absence  of  noise,  all  we  would  be  able  to  conclude  by  observing  the  output 
f[s(t)]  would  be  whether  s(t)  r.  a or  s(t)  > a.  In  sharp  contrast  to  this, 
when  there  Is  additive  Gaussian  noise  N the  first  order  moment  of  f[s(t)+N(t)] 
Is  sufficient  to  reconstruct  the  signal  s. 
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Wt  iow  turn  our  attention  to  nonlinearities  that  are  not  monotonic. 


The  first  result  1.(  this  direction  concerns  certain  odd  functions. 

Theorem  2.  The  signal  s(t)  can  be  reconstructed  from  the  first  moment  m^t) 
of  the  output  process  when  the  nonconstant  nonlinearity  f Is  odd,  satisfies 
f(x) € L2($(x;o)dx,and  is  such  that  the  coefficients  In  Its  Hermlte  expansion 
are  nonnegative. 

Proof.  By  (4)  of  Proposition  1,  we  have  for  all  -»<x<», 

m'(x)  • i, n v"-'  • 

Since  f is  odd,  a °»  and  thus 
00 

- l (2nH-1)a-  .x2'"  > 0 
T m»0 

for  all  x/0,  since  at  least  one  of  the  nonnegatlve  coefficients  ta2m+l*  1s 
positive.  It  follows  that  wf(x)  is  strictly  Increasing  and  thus  s(t)  can  be 
reconstructed  from  m^(t)  = uf[s(t)].  D 

It  should  be  pointed  out  that  one  may  easily  construct  examples  of  non- 
monotonic nonl Inearl  ties  f satisfying  the  conditions  of  Theorem  2.  For  ex- 
3 2 2 

ample,  f ( x)  = x -a  x = 2a  H,  (x)  + H-  (x)  Is  clearly  nonmonotonic  and 

I f O <j  i o 

2 2 

satisfies  the  conditions  of  Theorem  2.  In  fact  p^(x)  * x(x  +2o  ) Is  strictly 
monotonic. 

From  now  on  we  concentrate  on  nonl inearl  ties  f symmetric  around  an  arbi- 
trary point  Xq. 

Theorem  3.  If  f Is  nonconstant,  symmetric  around  some  Xq,  and  satisfies  either 
(a)  or  (b): 
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(a)  f is  monotonic  on  [Xq,"-)  and  f(x)  € L2(<J>(x;o)dx) , 

(b)  f(x+Xg) € L2(^ < x ;o)dx ) and  the  coefficients  ta2n)n*l 
Hermite  expansion  are  nonnegative, 

then  |s(t)-Xg|  can  be  reconstructed  from  the  first  moment  m^(t)  of  the  output 
process. 

Proof.  We  first  note  that  the  symmetry  of  f around  Xq  Implies  that  of  vy(x): 

00  00 

Mf(x0-x)  3 / f(x0-x+y)<()(y;o)dy  = / f(Xg+x-y)4>(y;o)dy 


3 / f(x0+x+z)<f >(z;n)dz  = Uf(x)+x). 

-CO 

(a)  By  (5)  of  Proposition  1 we  have  for  all  x 

Oy 

ui(x)  58  'V  / y[f(x+y)  - f(x-y)]<j>(y;o)dy  . 
a6  o 

Suppose  f is  nondecreasing  on  [xQ,»).  Then  for  every  x>Xg,  we  have 
f(x+y)-f(x-y)  * 0 for  all  y>0  and  leb{y:  f(x+y)-f(x-y)  > 0} > 0. 

It  follows  that  u^(x)  >0  for  x Xq  and  thus  u^(x)  is  strictly  Increasing  on 
(x^00).  Similarly,  if  f is  nonincreasinp  on  [Xg,®),  u^.(x)  is  strictly  decrees 
ing  on  [Xg,®).  Thus  u^(x)  is  symmetric  around  Xg  and  strictly  monotonic  on 

(Xg,“). 

(b)  By  (4)  of  Proposition  1 applied  to  g(x)  * f(x+Xg),  we  have  for  all  x 

|Jg(x)  ■ 1.  anx° 
a n*0 

and 

Mf(x)  - Ug(x-Xg)  - l an(x-x0)n. 

Since  g(x)  Is  even,  a^+j  = 0,  and  thus 


Is  symmetric  around  xQ  and  Is  strictly  Increasing  on  (xq,“), since  a2n*0,n*l» 
with  at  least  one  coefficient  positive. 

Since  In  both  cases  (a)  and  (b),  pf(x)  Is  symmetric  around  xQ  and  strictly 
monotonic  on  (x0,»),  js(t)-x^|  can  be  reconstructed  from  m,(t)  * p^[s(t)].  D 

We  remark  that  if  the  signal  s In  additive  noise  N can  be  observed  through 
two  nonlinearities  f and  ?,  satisfying  the  conditions  of  Theorem  3 with  distinct 
centers  Xq  and  Xq,  then  s(t)  can  be  reconstructed  from  the  two  moment  functions 
mj(t)  and  m^t),  since 

]s(t)  - xQ|2  - |s(t)  - xQj2  * (Xq  - xQ)  [2s ( t ) -Xq-Xq] . 

It  is  clear  that  for  the  nonlinearities  f satisfying  the  conditions  of 
Theorem  3,  the  first  order  moment  function  m^(t)  of  the  output  process  deter- 
mines | s(t)-xQl  and  we  are  left  with  the  problem  of  determining  the  sign  of 
s ( t ) - x0  for  each  t.  This  is  now  accomplished  by  using  the  correlation  function 
C(t,t)  of  the  output  process. 

Theorem  4.  Assume  f is  nonconstant,  symmetric  around  some  Xq  and  satisfies 
either  (a)  or  (b): 

(a)  f Is  bounded  below  or  above,  monotonic  on  [Xq»°°)  and  such  that 
f2(x)€  L2(<p(x;o)dx), 

(b)  f2(x+XQ)  € L2 ( ^ ) dx ) and  the  coefficients  {«2n of  fU+Xp)  In 
Its  Hermlte  expansion  are  nonnegative. 

Assume  the  correlation  function  R of  the  noise  N has  at  most  a finite  number 
of  zeros  on  each  finite  interval.  Then  from  the  mean  function  m^  and  the  cor- 
relation function  C of  the  output  process,  a set  of  two  signals  s and  2Xq-s 


can  be  reconstructed  (there  Is  no  way  to  determine  which,  among  these  two. 

Is  the  actual  signal).  When  f Is  even,  l.e.  xQ*0,  then  the  signal  s Is  re- 
constructed up  to  a global  sign. 

Proof.  (a)  f clearly  satisfies  the  conditions  of  Theorem  3(a)  and  thus  the 
function  a(t)  « | s ( t) -Xq | , -®<t<®,  can  be  reconstructed  from  the  mean  function 
m^ . For  any  t such  that  a(t)  3 0,  we  have  s(t)  * xQ.  Consider  now  two  dis- 
tinct points  t and  x such  that  a(t)  j*  0 f a(x)  and  R(t-x)  f 0.  We  then  have 
s(t)  - xQ±a(t),  s(t)  « x0±a(x)  and 

C(t,x)  * rf[s(t),s(x);o‘2R(t-x)]. 

Therefore,  C( t ,t)  Is  equal  to  at  least  one  of  the  four  numbers 

• ? 

rf[x0±a(t),XQ±a(x);o  R(t-x)],  which  are  related  as  follows  (for  brevity, 
we  drop  the  dependence  of  on  R): 

rf[x0+a(t),x0+a(i)]  f rf[x0+a(t),x0-a(x)] 

t ) »^q"^®( t) 3 f i ^[xg_a( t)  ,Xg-a(x) } 

by  Proposition  3,  and 

rf[x0+a(t),x0+a(x)3  = rf[x0-a(t),x0-a(x)] 
rf[x0+a(t),x0-a(x)]  = rf[xQ-a(t) ,xp+a(x)] 

since  for  all  x,y,  rf(xQ-x,xQ-y)  » r^Xg+x.XQ+y) , a straightforward  consequence 
of  the  symmetry  of  f around  xQ.  It  follows  that  if  we  choose  s(t)  ■ xQ+a(t), 
then  exactly  one  of  the  two  values 

rf[V$(t),x0+a(T)],  if[x0+a(t),x0-a(x)] 

will  equal  C(t,i),  and  if  we  choose  s(t)  = xp-a(t)  then  again  exactly  one 
of  the  two  values 

rf[xQ-a(t) ,x0+a(x)].  rf[xQ-a(t) ,x0-a(x)] 

will  equal  C(t,x).  Thus  for  each  choice  of  s(t),  the  value  of  s(r)  is  uniquely 
determined  by  the  correlation  C(t,x). 
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a 


The  reconstruction  procedure  Is  now  clear:  If  a(t)  ■ 0,  then  s(t)  ■ Xq. 

Otherwise,  fix  an  arbitrary  point  tg  with  a(tg)jK)  and  let  t be  such  that 

a(t)fO  and  R(t-tg)fO.  Then  for  each  possible  choice  of  s ( t^ ) * s(tQ)  « x0+a(tQ) 

or  s(tQ)  * XQ-a(tQ),  s(t)  is  uniquely  determined  by  comparing  C( tg ,t)  with 

.2 

the  two  numbers  [s( tQ) ,x0*a(t) ,o  R(tg-t)].  Thus,  we  determine  two  signals 
Sj  and  s2  which  are  "-elated  by  s^(t)+s2(t)  ■ 2xQ  for  all  t and  which  give  rise 
to  the  known  mean  and  correlation  functions  m^  and  C.  It  Is  also  clear  from 
the  above  that  the  actual  signal  s giving  rise  to  the  known  mean  and  correla- 
tion functions  m^  and  C must  be  Identically  equal  on  (-«,<»)  to  either  s1  or  s2. 

Thus,  the  reconstructed  set  of  two  signals  (s^,s2)  Is  the  same  as  the  set 
{s,2Xq>s}.  In  particular,  when  the  nonlinearity  f Is  even,  l.e.  Xg«0,  then 
the  actua'l  signal  s Is  reconstructed  up  to  a global  sign. 

(b)  Follows  In  a similar  manner  by  using  Theorem  3(b)  and  Proposition  3(b).  O 

Some  simple  examples  of  nonlinearities  f satisfying  the  conditions  of 
Theorem  4(a)  are 

C(x-k0)1 2"-I>*],  £Cx-x0)Zn*b2]->.  exp[-«Vx0|b],l(a_b)(x). 

2 

where  -*»<a<b<«>  and  n*1,2,...  . When  f(x)  • x , the  result  of  Theorem  4 was  ob- 
tained by  Grunbaum[l],  who  was  the  first  to  consider  this  problem. 

The  two  classes  of  nonlinearities  considered  In  (a)  and  (b)  of  Theorem  4 
are  distinct,  as  the  following  examples  show.  For  simplicity,  assume  xQ«0  and  o»l. 

(1)  f(x)  • (x2-2)(x2-4)  = H4J(x)  > 5 

satisfies  the  conditions  of  Theorem  4(b)  but  not  those  of  Theorem  4(a),  since 
f Is  clearly  nonmonotonic  on  [0 ,<«) . 
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(11)  f (x)  « x6-18x4  + 114x2  - 75 

* h6j(x)  - 3H41(x)  + 51  H2^(x). 

2 

Then  f'(x)  ■ 6x[(x-6)  +2]  > 0 for  x > 0 so  that  f Is  monotcnic  on  [0,«) 
and  satisfies  the  conditions  of  Theorem  4(a).  On  the  other  hand,  the  co- 
efficient of  j(x)  Is  negative  and  thus  f does  not  satisfy  the  conditions 
of  Theorem  4(b). 

The  results  of  Theorem  4 provide  a substantial  Improvement  over  the  no 

noise  case.  As  a simple  example  that  Illustrates  this  point,  consider  an 

even  nonlinearity  which  Is  strictly  Increasing  on  [0,®°):  In  the  absence  of 

noise,  the  output  f[s(t)]  determines  |s(t)|  and  we  are  left  with  determining 

the  sign  of  s(t)  for  each  t.  Thus  the  number  of  distinct  signals  with  the 

given  absolute  value  Is  In  general  uncountably  Infinite.  If  s Is  known  to 

N-f  1 

be  a continuous  function,  we  then  have  2 distinct  signals;  the  value  of 
N can  be  read  off  the  graph  of  the  function  |s(t)|  and  may  be  finite  or  In- 
finite (N  Is  the  number  of  points  t such  that  s(t)  * 0 and  s(x)  i 0 In  some 
left  neighborhood  of  t).  In  sharp  contrast,  In  the  presence  of  Gaussian 
noise  N satisfying  the  condition  of  Theorem  4,  the  mean  and  correlation  func- 
tions of  the  output  process  f[s+N]  determine  s up  to  a global  sign.  This 
substantial  Improvement  over  the  no  noise  case  is  due  to  the  fact  that  the 
Gaussian  noise  takes  all  real  values  and  thus,  the  output  mean  and  correlation 
functions  contain  more  Information  about  s than  just  f(s).  Even  more  Illumin- 
ating Is  the  case  where  the  nonlinearity  f Is  a symmetric  Interval  window 
f(x)  * ^[-a,a]^’  In  *bsence  of  n°ise,  can  only  determine  whether 
I s ( t ) | <«or  | s( t)  | > a for  each  t;  In  the  presence  of  the  noise  N,  the  sig- 
nal s Is  determined  up  to  a global  sign. 


It  should  be  noted  that  the  condition  on  the  zeros  of  the  noise  covariance 
R imposed  In  Theorem  4 could  be  weakened  In  certain  cases.  For  example, 

It  Is  clea*'  that  the  reconstruction  procedure  of  Theorem  4 remains  valid 
with  no  conditions  on  R In  case  the  function  | s ( t ) - Xq | , which  Is  reconstructed 
from  the  output  moment  function  m^,  satisfies 
|s(t)-xQ|  > 0 a.e.  for  a < t < b 
and 

|$(t)-x0|  ■ 0 for  t^  (a ,b) 

for  some  -®sa<b*».  Next  suppose  that  for  some  -®<a<b<®, 

|s(t)-xQj  = 0 for  a * t < b 
and 

| s( t )-xQ | > 0 a.e.  for  t $ [a»b]. 

Then  for  the  reconstruction  procedure  of  Theorem  4 to  be  feasible,  we  need  that 
R(t)  f 0 for  some  t>b-a,  which  Is  much  weaker  than  the  condition  imposed  In 
Theorem  4.  The  main  point  here  Is  that  the  reconstructed  function  |s(t)-XQ| 
enables  us  to  check  whether  or  not  a given  noise  covariance  R allows  the  re- 
construction procedure  of  Theorem  4 to  apply. 

For  arbitrary  covariances  R,  we  can  always  reconstruct  a set  of  at  least 

two  signals  containing  the  actual  signal.  As  an  example,  consider  the  case 

where  R(t)  * 0 for  all  |t|  *T,  e.g.  triangular  covariance.  Denote  by  N ;he 

number  of  those  open  Intervals  of  zeros  of  |s(t)~x.j|  whose  length  Is  * 2T. 

N+1 

Then  a set  of  2 signals  can  be  reconstructed  by  applying  the  procedure  dcs> 
crlbed  In  the  proof  of  Theorem  4 to  each  of  the  (N+1)  Intervals  ove**  which 
|s(t)-xQ|  >0  a.e.  This  set  contains  the  actual  signal  s and  any  two  signals 
Sj,s2  In  the  set  satisfy  Sj(t)  ■ *2(t)  or  Sj(t)  ♦ $2(t)  ■ 2xq  for  each'lxed  t. 


In  case  higher  order  moments  of  the  output  process  f[ s(t)+N(t)]  are 
available,  results  similar  to  those  of  Theorem  4 can  be  obtained  for  addi- 
tional classes  of  nonl Inearl  ties  f.  In  particular,  if  f2(x),  rather  then 
f(x),  satisfies  the  conditions  of  Theorem  4,  the  conclusion  of  Theorem  4 
remains  valid  provided  we  use  the  second  moment  function 
*2(t)  " E(f2Cs(t)  + N(t)]} 
and  the  fourth  order  correlation  function 

C2(t,t)  • E(fZ[$(t)  ♦ N(t)]f2[s(T)+N(T)]) 

of  the  output  process.  This  extension  covers  certain,  possibly  discontinuous, 
asymmetric  nonllnearltles  f such  that  f Is  symmetric  around  some  xQ,  as 
well  as  certain  odd  nonllnearltles  not  covered  by  Theorems  1 and  2.  For  ex- 
ample, the  nonlinearity  (with  o*l  for  simplicity) 
f(x)  ■ x3-7x  « H3  j(x)  - 4 ^ (x) 

Is  not  monotonic  nor  has  nonnegative  Hermlte  coefficients  and  hence  the  recon- 
struction of  the  signal  s Is  not  feasible  by  Theorems  1 and  2.  On  the  other 
hand, 

f2(x)  - (x3-7x)2  - H61(x)  ♦ «4J(x)  ♦ 10  H2  J(x)  ♦ 22 
and  thus  f*(x)  satisfies  the  conditions  of  Theorem  4(b).  Hence  the  signal  s 
can  be  reconstructed,  up  to  a global  sign,  from  the  moment  and  correlation 
functions  m^  and  of  the  output  process. 

Finally,  when  the  first  or  second  order  distributions  (rather  than  moments) 
of  the  output  process  are  known,  we  have  the  following  result,  where  8(f)  de- 
notes the  o-fleld  of  Borel  sets  generated  by  f. 
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Theorem  5 (1)  The  signal  s can  be  reconstructed  from  the  first  order 

distribution  of  the  output  If  8(f)  contains  an  Interval  of  the  form  (-<*,a) 
or  (a,«),  where  -«®<a<»,  or  two  finite  Intervals  (a,b)  and  (c,d)  with  a+b^c+d. 

(11)  If  8(f)  contains  a finite  Interval  (a,b)t  and  if  the  noise  correla- 
tion function  R has  at  most  a finite  number  of  zeros  on  each  finite  interval, 
then  a set  of  two  signals  s and  a+b-s  can  be  reconstructed  from  the  first  and 
second  order  distributions  of  the  output;  and  when  a«-b,  the  signal  s can 
be  reconstructed  up  to  a global  sign. 

(1)  follows  from  Theorem  1 and  the  remark  following  Theorem  3,  and  (11) 
follows  from  Theorem  4. 
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Fig.  1 The  graph  of  [♦(*-y|u)-$(z*y|u)3  and  typical  f(z). 
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